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Abstract 

This is an attempt to address diffusion phenomena from the point 
of view of information theory. We imagine a regular hamiltonian sys- 
tem under the random perturbation of thermal (molecular) noise and 
chaotic instability. The irregularity of the random process produced 
in this way is taken into account via the dynamic uncertainty mea- 
sured by a path information associated with different transition paths 
between two points in phase space. According to the result of our pre- 
vious work, this dynamic system maximizes this uncertainty in order 
to follow the action principle of mechanics. In this work, this method- 
ology is applied to particle diffusion in external potential field. By 
using the exponential probability distribution of action (least action 
distribution) yielded by maximum path information, a derivation of 
Fokker-Planck equation, Fick's laws and Ohm's law for normal diffu- 
sion is given without additional assumptions about the nature of the 
process. This result suggests that, for irregular dynamics, the method 
of maximum path information, instead of the least action principle 
for regular dynamics, should be used in order to obtain the correct 
occurring probability of different paths of transport. Nevertheless, 
the action principle is present in this formalism of stochastic mechan- 
ics because the average action has a stationary associated with the 
dynamic uncertainty. The limits of validity of this work is discussed. 

PACS numbers : 02.50.Ey (Stochastic processes); 05. 45. -a (Nonlinear 
dynamics); 66.10.Cb (Diffusion) 
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1 Introduction 



Diffusion is a mechanism by which components of a mixture are transported 
around the mixture by means of random molecular motion. Over 200 years 
ago, Berthalot postulated pQ that the flow of mass by diffusion across a plane 
was proportional to the concentration gradient of the diffusant across that 
plane. About 50 years later, Fick introduced [2 J two differential equations 
that quantified the above statement for the case of transport through thin 
membranes. Fick's First Law states that the flux J of a component of con- 
centration n across a membrane is proportional to the concentration gradient 
in the membrane: 

where x is the position variable (for 3 dimensional space, is replaced by 
the gradient V). Fick's Second Law states that the rate of time change of 
concentration of diffusant at a point is proportional to the rate of spacial 
change of concentration gradient at that point within the mixture 

dn = d dn(x) 

dt 8x [ dx J ' 1 ' 

If D is constant everywhere in the mixture, the above equation becomes 

dn _ jj d 2 n{x) 
dt dx 2 

Above normal diffusion laws are very precisely tested in experiments in 
most of solids, liquids and gases and are widely studied in nonequilibrium 
thermostatistics together with the Fokker-Planck equation of diffusion prob- 
ability, Fourier law of heat conduction and Ohm's law of electrical charge 
conduction j2l IH El El- Many efforts to derive theoretically Fick's laws were 
concentrated on special models of solids in which particles are transported. 
Other phenomenological derivations are also possible if one supposes Brow- 
nian motion and Markovian process[7], or Kolmogorov conditions [HJ. Al- 
though diffusion is associated with stochastic process with certain dynamic 
uncertainty, theoretical study and derivation of these laws using information 
methods, as far as we know, is still an open question. 

In this paper, we describe an attempt to investigate irregular dynamics 
by an information method. We imagine a hamiltonian systems under random 
perturbation of thermal noise and chaotic motion. This perturbation can be 
either internal or external. A isolated system containing a large number of 
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particles in random motion is an example of internal perturbation. A Brown- 
ian particle is an example of external perturbation due to random molecular 
motion around the particle. In these cases, the energy of the system and other 
mechanical quantities can fluctuate. The geodesies of regular dynamics will 
be deformed in such a stochastic way that following exactly the evolution of 
each mechanical quantity (e.g., action) is practically inconceivable. Hence 
in this approach, we use the action of the unperturbed hamiltonian system. 
The stochastic effect of random perturbation is taken into account through 
the dynamic uncertainty or information. Based on maximum information 
principle in connection with the unperturbed action, we developed a formal- 
ism of probabilistic dynamics within which the diffusion laws are a natural 
result of the differential equations of the probability distribution of action. 
The information addressed in this work is a quantification of the uncertainty 
of irregular dynamic process. Here we consider the following two dynamic 
uncertainties: 

1. Between any two fixed cells a and b in phase space, there may be dif- 
ferent possible paths (labelled by k—l,2,...w) each having a probability 
Pk(b\a) to be followed by the system. This is the uncertainty consid- 
ered by Feynman in his formulation of quantum mechanics ^3]. Here 
we introduce it for randomly perturbed dynamic systems. 

2. There are different possible paths leaving the cell a and leading to dif- 
ferent final cells b in a final phase volume B, each having a probability 
Pk{x\a) to be followed by the system, where x is the position of arbi- 
trary b. This uncertainty is the basic consideration for the definition of 
Kolmogorov- Sinai entropyfTU] used to describe chaotic systems. 

These dynamic uncertainties were proved (HI E] to take their maximum 
when the most probable paths are just the paths of least action. In what 
follows, we briefly present the method of maximum uncertainty or path in- 
formation for irregular dynamic systems and the concomitant "least action 
distributions" of transition probability. Then we focus on the particles dif- 
fusing in external field with potential energy U(x). The Hamiltonian of the 
particles is given by H = E + U where E is the kinetic energy. The above 
mentioned diffusion laws will be derived directly from the so called least 
action distribution. 
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2 Maximum path information 



We suppose that the uncertainty concerning the choice of paths by the sys- 
tems between two fixed cells is measured with the following path information 

w 

H ab = -^p k {b\a)\np k (b\a). (3) 
k=i 

where pk(b\a) is the transition probability between the cell a in the initial 
phase volume A and a cell b in the final phase volume B via a path k (k = 
1, 2, ...w). We have the following normalization 

w 

$>*(&|a) = l. (4) 
k=i 

It is also supposed that each path is characterized by its action A ab (k) defined 
in the same way as in regular dynamics without random forces by 

A ab (k) = ( L k (t)dt (5) 

Jtabik) 

where L k (t) = E — U is the Lagrangian of the system at time t along the 
path k. The average action is given by 

UI 

A ab = Y,Pk(b\a)A ab (k). (6) 

k=l 

It is known that, for a regular process, the trajectories of the system 
should have a stationary action (5A ab (k) = 0). For irregular dynamic process, 
this least action principle does not apply since there are many possible paths 
with different actions, not only the minimum action. For this kind of process, 
we suppose the stable probability distribution corresponds to a stationary 
uncertainty or path information H ab under the constraint associated with 
action. This means the following operation: 

w w 

S[H ab + aJ2 Pk(b\a) - V ]T Pk (b\a)A ab (k)} = (7) 

k=l k=l 

leading to 

Pk(b\a) = ^ exp[-r]A ab (k)], (8) 
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where the partition function 

Z = J2 e M-vA ab {k)}. (9) 

k 

The physical meaning of 77 will be discussed in the following section. 

It is proved that[H] the distribution Eq.(jHJ) is stable with respect to the 
fluctuation of action. It is also proved that Eq.(jHJ) is a least (stationary) ac- 
tion distribution, i.e., the most probable paths are just the paths of least ac- 
tion. We can write 5pk(b\a) = —r]pk{b\a)5A ab {k) = 0, which means 5A ab {k) = 
leading to Euler-Lagrange equation [T2] 

d dL k (t) dL k (t) Q 
dt dx dx 

and to Hamiltonian equations via the Legendre transformation H = Px — 
L k {t)M- 

X= dP andP = -^ (U) 
where P = mx is the momenta of the system. These equations are satisfied 
by the most probable paths but not the other paths. In general, the paths 
have neither 5A ab (k) = nor SA ab = 0, although the average action A ab is 
convex (concave) for r] > (77 < 0)0. Nevertheless, the average action does 
have a stationary associated with the stationary of the information H ab in 
Eq.0, i.e., 

- V 5A ab + 5H ab = 0. (12) 

Here we used J2k=i ^Pk(b\a) = 0. Eq. (fT2^) implies that, although the least 
action principle of classical mechanics cannot apply when the dynamics is 
perturbed by random and instable noise, the maximum path information 
introduced above underlies in fact the same physics in which the action prin- 
ciple is present as a average effect in association with the stationary dynamic 
uncertainty. Eq.(JT2J) will be used below in order to derive the averaged Euler- 
lagrange equation for irregular dynamics. 



3 A calculation of transition probability of 
diffusion 

In what follows, the action is calculated and analyzed with the Euler method. 
Let us look at a particle of mass m diffusing along a given path k from a 
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cell a to a cell b of its phase space. The path is cut into N infinitesimally 
small segments each having a spatial length Axj = Xj — Xj_i with i = 1...N 
(xq = x a and xn = x&). t = U — £j_i is the time interval spent by the system 
on every segment. The Lagrangian on the segment i is given by 



L{xi , Xi , tj 



2(^-t,-i) 2 \dx). 2 



- U(x^) 



(13) 



where the first term on the right hand side is the kinetic energy of the particle, 
the second and the third are the average potential energy on the segment i. 
The action of segment i is given by 



A: 



m(Axi) 2 _ Axi rTl . 

— — + Fi -t - U(xi-{\t, 

2t 2 v 1 ' 



where Fi = — (f^rj .is the force on the segment i. According to Eq.(J£ 
transition probability "Pili-\ from Xj_i to Xi on the path k is given by 



Pi,k = exp 

6i 



m A 9 r, t a 

—Ax; + Fj-Ax, 
2i 8 2 



(14) 
, the 

(15) 



where Z; is calculated as follows 



Zi = l dxi exp I —rj 

J — oo V 



ITT' A 9 ^ * A 

— Az? + Fi-Axi 
2t 1 2 



exp 



5m 



'27Tt 

mq 



(16) 



The potential energy of the point x^_i disappears in the expression of 
because it does not depend on Xi. 

At this stage, the physical meaning of r\ can be shown with a general 
relationship given by the following calculation of the variance : 



Axi = — 



/ dxiAx 2 exp I — j] 

J —oo \ 



ijj J —oo 

t 



171 A 9 ^ ^ A 

—Ax- + Fj-Ax, 
2t 4 2 



(17) 



This result can be compared to Brownian motion having Axf = ADt 7 . 
In this case we have r\ = j^d- ^ we s ^ m consider detailed balance [7 3 , we 
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get D = fik B T where \i is the mobility of the diffusing particles, k B the 
Boltzmann constant and T the temperature. This means 



7/ 
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2m^k B T 2k B T 



(18) 



where mj — - is the friction constant of the particles in the diffusion mixture. 



The total action given by 

N N r m(Ax,) 2 

=1 i=l L 



A*(*) = EA = E 



2t 



+ F i -Ax i -U(x i - 1 )t 



(19) 



J k 



so the transition probability from a to b via the path k is the following: 



N 



p k (b\a) 



-exp -r]J2 



i=i 



m(Axi 



2t 



l 2 



(20) 



i=i 



where 



A? 



fc=l 

/■OO 



i=l 



m(Aa; i ) i 
2t 



+ F i -Ax l 
2 



(21) 



A' 



= / dxidx 2 -.-dx N _ 1 exp — 77 E 

V i=i 



and 



exp 



p(6|a) 



2* 



' 8m 



N 



—) P (b\a) = Z?p(b\a) 
mi] J 



exp 



?2 rj(t b -t a ) 3 



mrj 



x exp —rj 



8m 
m(x b - Xg) 2 
2(4 - t a ) 



27r(t b - t a ) 
h — t a 



(22) 



In the above calculation, we have fixed the initial point x = x a and the final 
point xn = Xb- 

Now in order to see the behavior of transition probability with respect 
to final point, we have to relax x b = x and let it vary arbitrarily as other 
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intermediate points. This implies we take into account the second uncertainty 
due to chaotic motion mentioned in the introduction. The corresponding 
transition probability pk(x\a) from a to arbitrary x via the path k has been 
derived with the maximum path information combined with actional]. Here 
we only put it as follows: 

p k {x\a) = p(b\a)p k (b\a) (23) 

N 

= Y[Vk,i/i-l, 

i=l 

which is normalized by 

w „ 

X] ^2 Pk{ x b\a) = / dxidx 2 ...dxN_idxpk(x\a) = 1. (24) 
b k=i ■* 



4 A derivation of the Fokker-Planck equation 

The Fokker-Planck equation describes the time evolution of the probability 
density function of position and velocity of a particle. This equation can 
be derived if we suppose that the diffusion particles follow Brownian motion 
and Markovian process[7], or Kolmogorov conditions [8J. In what follows, it 
is shown that this equation can be derived in a quite general way without 
above assumptions. It is just the differential equation satisfied by the least 
action distributions given by Eq.([T5|) and Eq.()23p. 

The calculation of the derivatives an d 9 g^T 1 straightfor- 

wardly leads to 

dpi/j-i _ t d(FjPi/i-i) _^ 1 d 2 pi/j-i ^ 

dt m dxi 2mr] dxf 

This is the Fokker-Planck equation, where r is the mean free time supposed 
to be the time interval t of the particle on each segment of its path. In view 
of the Eq.p3~|). it is easy to show that this equation is also satisfied by pk(x\a) 
if Xi is replaced by x, the final position. Now let n a and rif, be the particle 
density at a and b, respectively. The following relationship holds 

n b = ^2n a p k (x\a) (26) 

k 
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which is valid for any n a . This means (n = and x = x^): 

dn t d(Fn) 1 d 2 n 
dt m dx 2mn dx 2 ' 

which describes the time evolution of the particle density. 

5 Fick's laws of diffusion 

If the external force F is zero, we get 

dn 1 d 2 n 



(27) 



(28) 



dt 2mn dx 2 

This is the second Fick's law of diffusion. The first Fick's law Eq.Q can 

n(x,t) dJ(x,< 

dt dx 



be easily derived if we consider matter conservation = — dJ ^ 1 ) where 



J(x, t) is the flux of the particle flow. 



6 Ohm's law of charge conduction 

Considering the charge conservation dp ^ t '^ = — , where p(x, t) = qn(x, t) 
is the charge density, j(x,t) = qJ(x,t) is the flux of electrical currant and q 
is the charge of the currant carriers, we have, from Eq. (J27l) . 

i= T -F P -±- d l (29) 
m 2mn dx 



where F = qE is the electrostatic force on the carriers and E is the electric 

dn 
•' dx 



field. If the carrier density is uniform everywhere, i.e., ^ = 0, we get the 



Ohm's law 



j = -qEp = aE, (30) 
m 



where a = — = is the formula of electrical conductivity widely used 

mm j j 

for metals. 
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7 Passage from stochastic to regular dynam- 
ics 



The present probabilistic representation of dynamics using least action dis- 
tribution underlies a biased formalism of classical mechanics defined with the 
deterministic Hamiltonian functional H. It is clear that Eqs. (jlUj) and (jllj) 
do not exist for the paths other than the unperturbed geodesies (least action 
ones). We have in general 5A a b(k) ^ which is either positive or negative, 
i.e., 



SA ab (k) 



d dL k {t) dL k {t) 



dt dx 



dx 



edt ^ 



(31) 



where e is an arbitrary variation of x (e is zero at a and b). Using the same 
mathematics as in [HZ] , we can prove that, if dA ab {k) = 9A Q b } k " > dx— 9A f} k ' > dx > 
(or <) 0, a deformed Euler-Lagrange equation follows 



dx 



d dL k {t) dL k {t) 



dt dx 



dx 



> (or < 0). 



Then with the help of the Legendre transformation H = Px — L k \F2 
derive 

x = — and P> (or<) - — , 



(32) 



we can 



(33) 



which are the Hamiltonian equations for irregular dynamic systems along the 
paths with non stationary action. The second equation above violates the 
Newton's second law. 

However, as mentioned above, the average action has a stationary asso- 
ciated with stationary path information as shown in Eq. (J12|) . This "least 
average action" can be used in the following calculations to derive an aver- 
aged version of the equations of motion of classical mechanics. 



5A ab = Y.Pk(b\a)5A ab (k) + Y,$Pk(b\a)A ab (k) 



' d dL k (t) 
dt dx 



! dL k (tY 
dx 



edt + 



5H, 
V 



ab 



(34) 
(35) 
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Now taking into account Eq.([12|). and using the usual mathematics[12j, we 
obtain an extended version of the Euler-Lagrange equations : 



\dt dx / \ dx 
and of the Hamiltonian equations 



ddL kab (t)\ /dL k Jt)\ Q 





*> = (-^> > (P) = -(^r) (37) 



where the average ( ) is taken over all the possible path between two points. 

At first glance, it may seems surprising that the non least action paths 
have non zero probability of occurring and the fundamental equations such 
as Eqs. (jlU|) and (jlljl be violated within classical mechanics. It should be no- 
ticed that the probabilistic approach of this work addresses the Hamiltonian 
systems subject to thermal noise and chaotic motion. So strictly speaking, 
the Hamiltonian of the systems does not exist. It exists only in an average 
manner as shown by Eq.(|36|) and Eq. (j37|) . The random perturbation is of 
course responsible for the violation of the fundamental equations of classical 
mechanics. In fact, we can introduce a random force R into the classical 
equations. For a path whose action is not at stationary, Eq.(pT7|) implies a 
Langevin equation: 

f) TT 

P — + * (38) 

where R is positive if 5A a b(k) > and negative if 5A a t,(k) < 0. From Eq. (|3TJ) . 
we must have (R) = 0. 

Logically, this probabilistic dynamics should recover the regular dynamics 
when the uncertainty tends to zero. In fact, the dispersion of action or 
the width of the least action distribution can be measured by the variance 
a 2 = ~M - ~A 2 = A* - A\ h . From Eqs.©, ®, © and ©, we get 



A, 



or] 
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(40) 



and 



H(a,b) = \nZ + rjA ab = In Z-rj— \nZ (41) 

When the system becomes less and less irregular, a 2 diminishes and the 
paths become closer and closer to the least action ones having stationary 
action A s * b at . When a 2 — > 0, the significant contribution to the partition 
function Z comes from the geodesies having A s J b at , i.e., Z — > exp[— rjA^]. 
From Eq. (|4()jl . A ab — > A s * b at . Then considering Eq. ()41j1 . it is clear that the 
path information H(a,b) — > 0. In this case, the stationary average action 
Eq.ffT^j) becomes SA s J- b at = 0, the usual action principle, and Eqs.([36j) and 
(13 7|) will recover Eqs.()10|) and ()11|) . At the same time, diffusion phenomena 
completely vanish and the diffusion laws are replaced by the laws of regular 
mechanics. 



8 Concluding remarks 

We have presented an attempt to investigate diffusion phenomena with a 
method which consists in placing hamiltonian systems under the random 
perturbation of thermal noise and chaotic instability and addressing the ir- 
regular dynamics produced in this way with a information approach. A path 
information is used to measure the dynamic uncertainty associated with dif- 
ferent possible transport paths in phase space between two points. On the 
basis of the assumption that the paths can be physically characterized by 
their action (defined by using the unperturbed Hamiltonian), we show that 
the maximum path information yields a path probability distribution in ex- 
ponential of action. 1 This least action distribution provides a simple and 
general derivation of the Fokker-Planck equation, the Fick's laws, and the 
Ohm's law. The mathematics of this derivation is not new. It can be found 
in many text books treating diffusion on the basis of Brownian motion and 
Markovian process. The new point of this work is using the information 

would like to note here that this exponential transition probability distribution of 
action has nothing to do with the Feynman's postulated quantum propagator proportional 
to the path integrals of an exponential of action multiplied by the imaginary number 
Although the mathematics of this work is similar to that of the path integrals, the physics 
is totally different. In path integral quantum theory, the transition probability between 
two points is the absolute square of the propagator, hence it is not necessarily exponential 
of action. 
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method combined with the action principle underlying a transition proba- 
bility in exponential of action and a probabilistic formalism of dynamics for 
the hamiltonian systems under random perturbation. The reasoning is sim- 
ple and the mathematics is straightforward. The usual assumptions |S] for 
the derivation of diffusion laws, e.g., Brownian motion, Markovian process, 
Gaussian random forces, or Kolmogorov conditions, are unnecessary in this 
approach. 

Although in this approach the action of individual paths is not at sta- 
tionary, the stationary path information assures that the action of the most 
probable paths has a stationary and that the average action over all possible 
paths have also a stationary under the constraint associated with dynamic 
uncertainty. This result suggests the following analogy: as the Newton's law 
is the consequence of action principle of regular hamiltonian systems, the dif- 
fusion laws can also be considered as the consequences of this same principle 
which presents itself through the stationary average action associated with 
irregular dynamic uncertainty. 

The validity of the present work is of course limited by the mathematical 
tools we use in this work. As far as we can see, the results of this work 
probably does not hold if, 1) the dynamic uncertainty cannot be measured 
by Shannon information; 2) the paths of the diffusants is not sufficiently 
smooth for the application of the Euler method; 3) the paths do not allow 
continuous variational method. The latter two cases may occur when, for 
example, the phase space is porously occupied such as in fractal phase space. 
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